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AUTOMATIC CONTROL SYSTEM 
GENERATION FOR ROBOT DESIGN 
VALIDATION 

STATEMENT REGARDING FEDERALLY 5 

SPONSORED RESEARCH AND DEVELOPMENT 

The invention was supported by NASA under contracts 
NNC05CA77C and NNC06CA27C. The U.S. Government 
has certain rights in the invention. 

FIELD OF THE INVENTION 

The invention generally relates to robotics and more spe- 
cifically to generating a robotic validation system for a robot 
design. 

BACKGROUND ART 

20 

Many good CAD (computer-aided design) software pack- 
ages support design, such as SOLID WORKS, UG NX, and 
PRO/ENGINEER. Also many good packages provide analy- 
sis, such as WORKSPACE5, DARVIM2K, and ADAMS. Yet 
design and analysis packages rarely work together well to 25 
meet the specific needs of robot designers. For maximum 
efficiency, a robot designer might want to modify a hardware 
design and test it in software 1 0-20 times in a workday. Yet 
modifying a robot design on one software package, then 
converting and validating it on another can take days of effort, 30 
and when finished, the designer may not have access to the 
information really needed for robot analysis, such as control 
torques and sensor data. This inefficiency is expensive and 
time consuming, and it is detrimental to the quality of robot 
designs. 35 

New ways for connecting the existing well- solved pieces 
of the robot design cycle as well as new robot- specific analy- 
sis are needed. Constructing a part in a CAD program is 
largely solved. Simulating rigid-body dynamics with differ- 
ential equations is largely solved. A challenge lies in connect- 40 
ing these and other components and integrating human input 
in an efficient way. 

Another challenge lies in adding all the capability needed 
by roboticists. Most commercial packages are not tailored to 
robotics. To make a complete product that will find wide 45 
acceptance and use, new algorithms and software should 
support robotic workspace, control, manipulation, sensor, 
actuator, and locomotion analysis. The human interface 
should provide robotics-tailored data, described using robotic 
terminology. A new software framework that integrates com- 50 
mercial capability where available and adds new capability 
where needed may change the nature of development for the 
entire robotics field. 

DISCLOSURE OF THE INVENTION 55 

According to a first aspect of the invention, a method for 
generating a validation system to validate a robot design of a 
robotic system, comprises the steps of: automatically con- 
verting a robot design into a generic robotic description using 60 
a predetermined format; automatically generating a control 
system from the generic robotic description; and updating 
robot design parameters of the robotic system with an analy- 
sis tool using the generic robot description and the control 
system. 65 

According further to the first aspect of the invention, the 
updating of robot design parameters may be automatic. 


2 

Further according to the first aspect of the invention, the 
robot design may be loaded from robot design software. 

Still further according to the first aspect of the invention, 
the robot design may comprise at least one of: a) a hardware 
design, b) an electronic design, and b) surface properties. 

According further to the first aspect of the invention, the 
analysis tool may provide a simulation and the simulation 
may be at least one of: a) a kinematic simulation, b) a dynamic 
simulation, c) a terrain simulation. 

According still further to the first aspect of the invention, 
the predetermined format may be at least one of: a) an exten- 
sible markup language (XML), and b) a text based format. 

According further still to the first aspect of the invention, 
the robotic description may comprise at least one of: a) a 
model of the environment, and b) sensor models. 

According yet further still to the first aspect of the inven- 
tion, the control system may comprise at least one of: a) a 
kinematic component, b) a dynamic component, c) an adap- 
tation feature for avoiding self-collisions and collisions with 
the environment, and d) an adaptation feature to control 
deforming links and avoid collisions with the deforming 
links. 

Yet still further according to the first aspect of the inven- 
tion, the robotic system may comprise at least one feature out 
of: a) one or more articulated manipulators with one or more 
rigid or deforming links having a fixed base, b) one or more 
articulated mobile mechanisms with one or more rigid or 
deforming links, c) a bifurcating kinematic structure, and d) a 
closed kinematic structure. 

Still yet further according to the first aspect of the inven- 
tion, the generating the robotic validation may be provided 
using at least one of: a) network communications, and b) 
network communications over Internet. 

Still further still according to the first aspect of the inven- 
tion, the robotic system may be controlled using at least one 
of: a) network communications; and b) network communica- 
tions over Internet. 

According further still to the first aspect of the invention, 
the control system may be established using at least one of: a) 
network communications; and b) network communications 
over Internet. 

According yet further still to the first aspect of the inven- 
tion, the robotic system may be used for at least one applica- 
tion out of: a) space applications, b) military applications, c) 
agricultural applications, d) medical applications, e) domes- 
tic applications, f) mining applications, and g) agricultural 
applications. 

According still yet further still to the first aspect of the 
invention, the updating robot design parameters may com- 
prise calculating updated robotic parameters by the analysis 
tool using at least one of: a) Monte Carlo analysis, b) para- 
metric analysis, and c) parameter-optimization analysis. Fur- 
ther, the updating robot design parameters may comprise 
using automatically the updated robotic parameters calcu- 
lated by the analysis tool to improve the design of the robotic 
system by the design tool. Still further, the updated robotic 
parameters may be provided to a design tool for improving 
the design of the robotic system by the design tool. 

Yet still further according to the first aspect of the inven- 
tion, the general robotic description may comprise at least one 
of the following features: a) shapes, b) links, c) manipulators, 
d) stated systems, e) mechanisms with generic joint articula- 
tion comprising sliding, rotational, elliptical, or spherical 
articulations, and f) automatic simplification of the hardware 
design comprising physical dimensions, surface properties, 
kinematics properties or dynamics properties. 



US 8,301,421 B2 


3 

Still yet further according to the first aspect of the inven- 
tion, the control system may use Jacobian-based algorithm. 
Further, the control system may use a velocity control frame- 
work using the following algorithm: 

5 

V=J{q)q\ (1), 

wherein V is an m-length vector representing a motion of end 
effectors; q is a vector of joint positions, q* is an n-length 
vector formed by augmenting a derivative vector q with linear ^ 0 
and angular velocities of a base link of the robotic system; and 
J is an mxn Jacobian as a function of q, wherein 



wherein is annx(n-m) set of vectors that spans a null space 

of J, a is a scalar, W(q) is a matrix function, and F(q) is a ^ 
vector function. 

According to a second aspect of the invention, a computer 
program product comprising: a computer readable storage 
structure embodying computer program code thereon for 
execution by a computer processor with the computer pro- 2 5 
gram code, characterized in that it includes instructions for 
performing the steps of the first aspect of the invention, indi- 
cated as being performed by any component of the validation 
system. 

According to a third aspect of the invention, a robotic 30 
validation system for a robot design of a robotic system 
performed automatically, comprises: a design software inter- 
preter, for converting the robot design into a generic robotic 
description using a predetermined format, and for generating 
a control system from the generic robotic description; and an 35 
analysis tool, for updating robot design parameters of the 
robotic system using the generic robot description and the 
control system. 

According further to the third aspect of the invention, the ^ 
design software interpreter may be a client node of a network. 

Further according to the third aspect of the invention, the 
robotic validation system may comprise an analysis software 
interpreter, for converting the generic robotic description to a 
native format of the analysis tool. Further, the analysis soft- 45 
ware interpreter may be a client node of a network. 

Still further according to the third aspect of the invention, 
the robotic validation system may comprise a design tool, for 
reading a file describing the robot design in a native format for 
converting the robot design to the generic robotic description 50 
using the predetermined format. Further, the robotic valida- 
tion system may comprise a Post-processing tool, for writing 
results of the updating robot design parameters to improve the 
design of the robotic system by the design tool. 

55 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a better understanding of the nature and objects of the 
present invention, reference is made to the following detailed 
description taken in conj unction with the following drawings, 60 
in which: 

FIG. lisa block diagram of a robotic validation system for 
a robot design, according to an embodiment of the present 
invention; 

FIG. 2 is a flow chart of a robotic validation system for a 65 
robot design, according to an embodiment of the present 
invention; 


4 

FIG. 3 is a block diagram of a robotic validation system for 
a robot design for multiple client nodes using network con- 
nections, according to an embodiment of the present inven- 
tion; 

FIG. 4 a is a block diagram representing a tree structure for 
robot link’s physical extent, according to an embodiment of 
the present invention; 

FIG. 4 b are pictures of basic shapes which can be applied, 
according to embodiments of the present invention; 

FIG. 4c is a schematic representation of a string-to -surface- 
property map, according to an embodiment of the present 
invention; 

FIG. 5 is a schematic representation of a link for construct- 
ing a robotic description, according to an embodiment of the 
present invention; 

FIG. 6 is a schematic representation of a manipulator con- 
structed by connecting links in a tree structure, according to 
an embodiment of the present invention; 

FIG. 7 is a schematic representation of a stated system as a 
combination of a state and a system, according to an embodi- 
ment of the present invention; 

FIG. 8a is a simple form of input to the parametric study 
which utilizes a reference stated system, control system and 
run time, according to an embodiment of the present inven- 
tion; 

FIG. 8/? is a comprehensive form of input to the parametric 
study which uses any number of system changes combined 
with any number of state, placement and run-time changes, 
according to an embodiment of the present invention; 

FIG. 9 is a schematic diagram of an architecture supporting 
peer-to-peer organization for the network implementation of 
embodiments of the present invention; 

FIG. 10 is a schematic representation of a network imple- 
mentation, wherein each client maintains both primary LAN 
routing node and a primary WAN routing node, according to 
an embodiment of the present invention; 

FIG. 11a is a schematic representation of a terrain simula- 
tion, according to an embodiment of the present invention; 
and 

FIG. 116 is a schematic representation demonstrating the 
radius of influence method for terrain-robot interaction mod- 
eling, according to an embodiment of the present invention. 

MODES FOR CARRYING OUT THE INVENTION 

A new method, system and computer program are pre- 
sented for generating a robotic validation system for a robot 
design. According to an embodiment of the present invention, 
the validation system for a robot design (of a robotic system) 
is automatically generated by converting a robot design into a 
generic robotic description using a predetermined format, 
then generating a control system from the generic robotic 
description and finally updating robot design parameters of 
the robotic system with an analysis tool using both the generic 
robot description and the control system. There are many 
variation and implementation options according to embodi- 
ments of the present invention. These embodiments are pro- 
vided below. 

The robot design can be loaded, e.g., from robot design 
software. The robot design can comprise hardware design, 
electronic design, and/or surface properties. Surface proper- 
ties can be defined by an appearance and/or mechanical prop- 
erties of the surfaces. For example, surface properties can be 
(but are not limited to) any generic information like color, 
transparency, shininess, spring constant for defining stiffness, 
hardness, flexibility, fragility, friction properties, etc. The 
robotic description can comprise (but is not limited to) a 
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model of the environment and/or sensor models (e.g., for 
providing a force feedback to assist with grasping objects), 
such as touch sensors, force sensors, joint encoders, acceler- 
ometers, gyroscopic sensors, color cameras, gray-level cam- 
eras, ladar, or hyperspectral sensors. 

The robotic system can be used (but is not limited to): space 
applications, military applications, agricultural applications, 
domestic applications, mining applications, medical applica- 
tions, etc. The robotic system can comprise the following 
features: 

a) one or more articulated manipulators with one or more 
rigid (in general, links can be perfectly rigid, i.e., no 
bending, growing, shrinking, etc.) or deforming links 
(deforming links, designed to change shape in a control- 
lable way, are not rigid bodies and typically have more 
degrees of freedom than rigid bodies, e.g., more than 6 
degrees of freedom;) having a fixed base (fixed based 
robots are often seen in manufacturing wherein, e.g., an 
arm is attached to a fixed base which cannot move, 
whereas mobile robots may be on mobile platforms 
often on wheels, legs, or tracks); 

b) one or more articulated mobile mechanisms with one or 
more rigid or deforming links, and/or 

c) a bifurcating kinematic structure. 

The general robotic description can comprise (but is not 
limited to) the following features: shapes, links, manipula- 
tors, stated systems, mechanisms with generic joint articula- 
tion comprising sliding, rotational, elliptical, or spherical 
articulations, and/or automatic simplification of the hardware 
design comprising physical dimensions, surface properties, 
kinematics properties or dynamics properties. 

The control system can be automatically generated from 
the robotic description. The control system can comprise (but 
may not be limited to): a kinematic component, a dynamic 
component, an adaptation feature for avoiding self-collisions 
and collisions with the environment, and an adaptation fea- 
ture to control deforming links and provide collision avoid- 
ance with deforming links. 

The predetermined format may be generally text based and 
can use, e.g., an extensible markup language (XML). The 
network communications (e.g., over Internet) can be used for 
generating the robotic validation, for controlling the robotic 
system, and/or for establishing the control system. 

The analysis tool can provide a simulation which can (but 
is not limited to) kinematic simulation, dynamic simulation, 
and/or terrain simulation. The updating of robot design 
parameters can comprise calculating updated robotic param- 
eters by the analysis tool using (but not be limited to) the 
following methods: Monte Carlo analysis, parametric analy- 
sis, and/or parameter optimization control. The updating of 
robot design parameters can comprise using automatically 
the updated robotic parameters calculated by the analysis tool 
to improve the design of the robotic system by the design tool. 
The updated robotic parameters can be provided to a design 
tool for improving the design of the robotic system by the 
design tool. 

FIG. 1 is an example among others of a block diagram of a 
simplified robotic validation system 10 for a robot design, 
according to an embodiment of the present invention. The 
example of FIG. 1 can be implemented, e.g., on one computer. 
The design tool 12 can be CAD software represented, e.g., in 
SOLID WORKS. The CAD software (the block 12) reads a 
file describing a robot design in its proprietary format. 

In response to an appropriate command from the user, the 
design software interpreter 14 converts the file describing a 
robot design (e.g., a CAD hardware design) into a specific 
robotic description using a predetermined format, e.g., exten- 
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sible markup language (XML). Typically, the design software 
interpreter 14 is plugged into the CAD software at load time 
(e.g., component object model (COM) or dynamic link 
library (DLL) linking can be used to accomplish this integra- 
5 tion). Because it is plugged in at run-time, the interpreter 14 
can use the calling methods of the design tool 12 (e.g., the 
CAD software) to get the hardware design. Along with the 
specific robotic description (e.g., an XML file with a conver- 
sion of the CAD hardware design), a new control system 
to (also, e.g., in the XML) for controlling the robot and appro- 
priate for the robot design is created by the interpreter 14 . The 
user can also specify the type of analysis/simulation (e.g., the 
parameter optimization, Monte Carlo simulation, parameter 
optimization study, kinematic simulation, dynamic simula- 
15 tion, and/or dynamic simulation, etc.) to be performed, typi- 
cally after being prompted by the interpreter 14. 

Moreover, if the analysis tool 18 cannot read the predeter- 
mined format (e.g., XML) directly, an analysis software inter- 
preter 16 converts the generic robotic description (e.g., in 
20 XML) to its native format. The analysis tool 18 then performs 
the analysis specified by the user with the results being fed 
back to the design tool 12 (e.g., using the interpreter 14). 
Alternatively, the analysis tool 18 can write out results to the 
native format of a post-processing tool 20. Then the post- 
25 processing tool 20 writes results in the XML which can be 
read by the design software interpreter 14 subsequently 
updating the CAD model of the robot design by using the 
calling methods of the design tool 12. 

FIG. 2 is a flow chart of a robotic validation system 10 for 
30 a robot design, according to an embodiment of the present 
invention. The flow chart of FIG. 2 only represents one pos- 
sible scenario among others. In a method according to the first 
embodiment of the present invention, in a first step 30, the 
robot design tool (e.g., CAD) 12 reads the file describing the 
35 robot design of the robotic system in its proprietary format. In 
a next step 32, the design software interpreter 14 converts the 
file describing the robot design into a generic robotic descrip- 
tion (e.g., XML). In a next step 34, subsequently, the design 
software interpreter 14 also generates a control system from 
40 the generic robotic description for controlling the robot (e.g. , 
also in XML). 

Moreover, in a next step 36, the analysis software inter- 
preter 16, if necessary, converts the generic robotic descrip- 
tion to a native format of the analysis tool 18. In a next step 38, 
45 the analysis tool 18 generates updated robot design param- 
eters (i.e., generates results) using the generic robot descrip- 
tion and the control system provided by the design software 
interpreter 14. Finally, in a next step 40, results generated by 
analysis tool 18 are written to the XML format or to a post 
50 processing tool (e.g., in the native format) subsequently 
updating the CAD model of the robot design by the design 
tool 12. 

FIG. 3 shows an example among others of a robotic vali- 
dation system 10a for a robot design for multiple client nodes 
55 using network connections, according to an embodiment of 
the present invention. The robotic validation system 10a (or 
the design-and-validation system) is organized using client 
and routing nodes that exchange information on robot design 
and analysis results over networked or direct connections. 
60 There are two possible groups of client nodes. One group can 
comprise N design software interpreters 14-1, 14-2, . . . , 
14-N. Each of these interpreters 14-1, 14-2, . . . , 14-N has 
similar functionality as the block 14 of FIG. 1. Another (op- 
tional) node group can comprise M analysis software inter- 
65 preters 16-1, 16-2, . . . , 16-M. Each of these interpreters 16-1, 
16-2, . . . , 16-M has similar functionality as the block 16 in 
FIG. 1 . The routing node (interface) 22 has a message handler 
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22 a which provides a network connnunication (e.g., through 
the Internet) between any of the client nodes 14-1, 14-2, . . . 
14-N and any of the client nodes 16-1, 16-2, . . . , 16-M. The 
validation reasoning block may represent software that 
ensures the validity of all exchanged messages, using, e.g., an 5 
XML schema. The system 10a can have K design tools 12-1, 
12-2, . . . , 12-K (e.g., installed on K network computers) and 
P analysis tools 18-1, 18-2, . . . , 18-P (e.g., installed on P 
network computers), wherein each of these blocks has the 
same functionally as blocks 1 2 and 18, respectively, in FIG. 1 . 10 
Each of the K design tools 12-1, 12-2, . . . , 12-K can use 
services of any or pre-selected design software interpreters 
from the N design software interpreters 14-1, 14-2, . . . , 14-N 
for translating to/from the predetermined format (e.g., XML). 
Similarly, each of the P analysis tools 18-1, 18-2, . . . , 18-K 15 
can use services of any or pre-selected design software inter- 
preters from the M analysis software interpreters 16-1, 
16-2, . . . , 16-N for translating to/from the predetermined 
format (e.g., XML). It is noted that K, N, M and P are integers, 
which can have different values or a combination thereof can 20 
have the same values. 

Direct interfaces to design and validation software is made 
through client nodes, and connections between design and 
validation software is made through routing nodes. When the 
nodes are parts of a single application, the communication 25 
will typically be through a direct exchange of information in 
memory. However, when the nodes are parts of the network, 
the communication will be, e.g., through the XML over TCP/ 

IP (transport control protocol/internet protocol) as illustrated 
in FIG. 3. 30 

The performance of the system 10a is similar to the per- 
formance of a simple system shown in FIG. 1. For example, 
the design software interpreter 14-1 takes the hardware 
design as contained in the CAD design software (i.e., the 
design tool 12-1) and converts it to the generic robotic 35 
description with a control system. The user can also specify 
the form of analysis to apply to the conversion (e.g., Monte 
Carlo simulation or other methods according to embodiments 
of the present invention). The routing node 22 automatically 
sends the data in the form of, e.g., XML to the computer with 40 
the analysis tool 18-1. If needed, the analysis software inter- 
preter 16-1 converts the XML to the format required by the 
analysis tool 18-1. The analysis tool 18-1 performs the simu- 
lation and sends results back to the CAD design software for 
updating the CAD model of the robot design by the design 45 
tool 12-1. 

Information passed from the design tool (e.g., 12, 12-1, 
12-2, . . . , or 12-K) to the analysis tool (e.g., 18, 12-8, 
12-8, . . . , or 18-P) can be (but is not limited to): 1) a 
description only of the system, with the type of analysis left 50 
up to the analysis tool or 2) both a system and a request for a 
specific type of analysis. The potential forms of the data 
transmitted from the design to the analysis tool are given in 
Table I below. 


TABLE 1 


Data Form Description 


Shape 

Link 


Manipulator 

Stated System 
Kinematic 


Any shape, including sphere, ellipsoid, capsule, 
polyhedron, and so forth. 

A single link in a robotic mechanism, which 
includes the shape, kinematics, mass properties, 
and actuator properties. 

A single robot, which includes any number of 
connected links. 

Any number of robots and their states. 

A simulation of a stated system, which includes 


60 


65 


8 


TABLE 1 -continued 


Data Form 

Description 

Simulation 

a stated system, visualization properties, 
and a kinematic control system. 

Dynamic 

A simulation providing all the capability of 

Simulation 

a kinematic simulation, but with dynamic 
simulation of articulation, physical impacts, 
and motor control. 

Parametric 

A study that changes parameters in fixed steps 

Study 

and tabulates outcomes. 

Monte Carlo 

A study that randomly varies parameters and 

Study 

tabulates simulation outcomes. 

Parameter 

A study that finds parameters that optimize a 

Optimization 

Study 

specified function of simulation outcomes. 


According to an embodiment of the present invention, a 
physical extent can be represented as a combination of geo- 
metric primitives through a tree structure shown in FIG. 4a. 
This tree structure is used to represent a robot link’s physical 
extent. Internal nodes can be unions or intersections, and the 
leaves are basic shapes. The most common shape is the poly- 
hedron. Other basic shapes provide a simpler representation 
for some applications and serve as bounding volumes to 
speed up calculations. The tree structure is composable at 
runtime, and can be easily modified (either directly or through 
the DLL) to support new geometric shape primitives or 
branching nodes. The leaves in the tree are shape primitives, 
some examples of which are shown in FIG. 4b. 

For rendering, simulation, and reasoning, every shape uses 
surface properties referenced by string tokens. Polyhedrons 
organize their polygons by surface property. This is illustrated 
in FIG. 4c. Each shape (shown in FIG. 4b) uses a string-to- 
surface-property map. Each surface property in turn main- 
tains string-entity maps, including string-string, string-float, 
and string-integer maps. These are configurable through the 
XML. They can represent virtually any property, including 
appearance, hardness, flexibility, fragility, and friction prop- 
erties. 

According to an embodiment of the present invention, the 
link is the fundamental object used to construct robot descrip- 
tions. Each link corresponds to a single robotic joint. The 
distal frame of one link is rigidly attached to the proximal 
frame of each child link in the kinematic structure. This 
allows multiple formalisms such as, e.g., Paul or Craig’s 
Denavit-Hartenberg (D-H) notation, and it supports the rep- 
resentation of new types of joints. Each link object, as illus- 
trated in FIG. 5 also holds mass properties, actuation param- 
eters, the physical extent of the link, surface properties 
descriptions, and joint-limit dynamics (which is of the form 
shown in FIG. 3b). In the FIG. 5 representing a link, the 
proximal D-H frame is rigidly attached to the parent. The 
distal D-H frame aligns with the proximal D-H frame of child 
links. 

The link’s mass properties can include, e.g., up to 10 
unique scalars needed for rigid-body dynamics calculations. 
These scalars represent, for example, the mass, center of 
mass, and second moment of inertia. The actuator parameters 
can include (but are not limited to) the motor friction, motor 
inertia, gearratio, and joint limits. Joint-limit dynamics are 
represented using a repulsive force or torque that is propor- 
tional to the incursion into a specified zone defining the hard 
stop. 

According to an embodiment of the present invention, a 
manipulator or robot is constructed by connecting links in a 
tree structure, as shown in FIG. 6. The structure supports any 
number of links and any number of bifurcations, such as those 
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present on LEMUR (legged excursion mechanical utility 
rover, see, e.g., T. Bretl, S. Rock, J.-C. Latombe, B. Kennedy, 
and H. Aghazarian, “Free-Climbing with a Multi-Use Robot, 
” Proceedings of the 2004 International Symposium on 
Experimental Robotics , Singapore, June 2004). One link 
serves as the base and its position and orientation are specified 
explicitly. In FIG. 6, a manipulator, or robotic mechanism, is 
defined through a link tree. Each individual link has the form 
shown in FIG. 5 and moves relative to its parent. The state of 
the robot includes the position and orientation of the base link 
and a joint value for all the other links. 

The unique robotic control techniques, according to an 
embodiment of the present invention, form a core component 
of a kinematic simulation, which includes a stated system, as 
described above combined with a configurable control sys- 
tem comprised of a velocity control system and a position 
control system. The control system is robust enough to be 
generated automatically, yet flexible enough to give the 
designer full control over behavior when desired. Velocity 
and position controls are described below. 

The core velocity-control framework is based on the Jaco- 
bian equation: 

V=J(q)q* (l), 

wherein V is an m-length vector representation of the 
motion of the end effectors (for example, linear and angular 
velocities referenced to points rigidly attached to parts of the 
robot); q is the vector of joint positions, q* is the n-length 
vector formed by augmenting q with the linear and angular 
velocity of the base link; and J is the mxn Jacobian, a function 
of q. When the robotic mechanism is kinematically redun- 
dant, the dimension of V is less than the dimension of q 
(m<n), and Equation 1 is under constrained when V is speci- 
fied. By using V to represent motion of one link relative to 
another, Equation 1 can support self-connecting mechanisms. 

The control framework calculates joint rates and base 
motion q* that best achieve a desired set of end-effector 
motions, V, by building on the method described in “On the 
Implementation of Velocity Control for Kinematically 
Redundant Manipulators,” J. D. English and A. A. Maciejew- 
ski, IEEE Trans, on Sys., Man, and Cybernetics — Part A: 
Systems and Humans, vol. 30, no. 3, May 2000, pp. 233-237, 
which uses a scalar a, a matrix function W(q), and a vector 
function F(q) to solve for q* as follows: 


J - 

l r v l 

.NjW. 

. -cvNj F _ 


wherein N j is an nx(n-m) set of vectors that spans the null 
space of J. That is, JN/=0, and N j has rank (n-m). N j is 
generally a function of q. By just changing the values of a, W, 
and F(q), many new and most established velocity -control 
techniques can be implemented, including pseudoinverse 
control (e.g., see “Review of Pseudoinverse Control for Use 
with Kinematically Redundant Manipulators,” C. A. Klein 
and C. H. Huang, IEEE Trans, on Sys., Man, and Cybernetics , 
vol. SMC-13, pp. 245-250, March/ April 1983), weighted 
pseudoinverse control (e.g., see “Robot Manipulability,” K. 
L. Doty, C. Melchiorri, E. M. Schwartz, and C. Bonivento, 
IEEE J. Robot. Automat ., vol. 11, pp. 462-468, June 1995), 
augmented Jacobian techniques (e.g., see “Task Space Track- 
ing with Redundant Manipulators,” O. Egeland, IEEE J. 
Robot. Automat ., vol. RA-3, pp. 471-475, October 1987 and 
“Configuration Control of Redundant Manipulators: Theory 
and Implementation,” H. Seraji, IEEE Trans. Robot. 
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Automat ., vol. 5, pp. 472-490, August 1989), extended Jaco- 
bian techniques (e.g., see “Kinematic Programming Alterna- 
tives for Redundant Manipulators,” J. Baillieul, Proc. 1985 
IEEE Int. Conf. Robot. Automat ., St. Louis, Mo., Mar. 25-28, 
5 1 985, pp. 722-728 and “Improved Configuration Control for 
Redundant Robots,” H. Seraji and R. Colbaugh, J. Robot. 
Syst., vol. 7, no. 6, pp. 897-928, 1990), and projection meth- 
ods (e.g., see “Optimal Rate Allocation in Kinematically 
Redundant Manipulators — The Dual Projection Method,” M. 
10 Z. Huang and H. Varma, Proc. 1991 IEEE Int. Conf Robot, 
and Automat., Philadelphia, Pa., Apr. 24-29, 1988, pp. 28-36 
and “An Efficient Gradient Projection Optimization for 
Manipulators with Multiple Degrees of Redundancy,” H. 
Zghal, R. V. Dubey, and J. A. Euler, Proc. IEEE 1990 Int. 
15 Conf. Robot, and Automat., Cincinnati, Ohio, May 13-18, 
1990, pp. 1006-101 1). These techniques can be used to opti- 
mize criteria such as balance, collision avoidance, joint-limit 
avoidance, and strength optimization. 

V represents the motion of all the robot’s end effectors 
20 concatenated into a single column. Many types of end effec- 
tors are supported, such as point constraints, frame con- 
straints, joint angle constraints, and center-of-mass con- 
straints. Any number of these different types can be used to 
define V. It is possible to exchange end-effector descriptions, 
25 and thereby change the definition of V, at runtime. 

The control system is organized into an XML-described 
tree structure that can formally represent the complexity in a 
realistic control system (complexity that might otherwise be 
hard coded), and it provides a method of organization that 
30 supports dynamic programming, i.e., the storage of subprob- 
lem solutions to prevent duplicate calculation. This dynamic - 
programming/logical-tree approach builds the W, F, and a 
parameters used in Equation 2 efficiently from user-defined 
XML data, allowing detailed algorithms to be constructed. 

35 Velocity control can be used for placing end effectors as 
follows: the current pose of an end-effector (location and 
orientation for a frame end effector, for example) and the 
desired pose are used to construct an end-effector velocity 
that, if followed, will give alignment. For point end effectors, 
40 the desired velocity of the point is simply a scalar gain times 
the difference in position. That is, if p^ is the actual position 
and p d is the desired position, then the desired velocity, v d , is 
given by the following, where k, is a positive gain: 

45 ( 3 ). 

For frame end effectors, every three-dimensional rotation 
can be expressed as a rotation about a single axis. Let the 
unit-norm axis of rotation between the actual and desired 
frames be u and the angle of rotation be 0. Then the desired 
angular velocity is given by 

w d =k a -Q-u, (4) 

where k a is a positive gain. This approach allows the velocity 
55 control system defined by Equation 2 to be used directly for 
position control. 

A simulation can be scripted, with desired end-effector 
positions configured off line, or interactive, with the end- 
effector paths controllable in real time by the user through a 
60 PC mouse. A scripted simulation enables the quick creation of 
animations and movies for observing and conveying behav- 
ior. Interactive simulations provide hands-on understanding 
of robotic capabilities and provide real-time interactive dem- 
onstrations. 

65 According to an embodiment of the present invention, a 
dynamic simulation can include all the capability of a kine- 
matic simulation plus numerical integration of Newton’s and 
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Euler’s dynamic equations for moving parts. Articulated 
dynamics, impact dynamics, and the dynamics of the motor 
controllers are also included. 

For articulated dynamics, two methods, e.g., can be used: 
the Articulated Body Inertia Algorithm (e.g., see M. W. 
Walker and D. E. Orin, “Efficient Dynamic Computer Simu- 
lation of Robotic Mechanisms,' "Journal of Dynamic Systems, 
Measurement, and Control, 104, 205-211, 1982, and A. 
Fijany and A. K. Bejczy, “An Efficient Algorithm for Com- 
putation of Manipulator Inertia Matrix,” Journal of Robotic 
Systems, 7(1), 57-80, 1990), and the Composite Rigid-Body 
Inertia Algorithm (e.g., see R. Featherstone, Robot Dynamics 
Algorithms , Kluwer Academic Publishers, Boston, 1987 and 
R. Featherstone and D. Orin, Proc. IEEE Conf. Robotics and 
Automation, San Francisco, Calif., 2000, pp. 826-834). 

The Order (N), for N links, Articulated Body Inertia algo- 
rithm is better suited for very large robots, while the Order 
(N 3 ) Composite Rigid-Body Inertia algorithm is better suited 
for simpler robots and passive environmental objects. Both 
methods can be numerically integrated using a configurable 
algorithm that relies on predictor and corrector integration 
algorithms, which are ideally suited for this application (e.g., 
see “Numerical Integration and Digital -Model Updates in the 
AIM-9X Simulation,” J. D. English and J. A. Bacon, Second 
Annual Systems Engineering Symposium, Raytheon, 
Waltham, Mass., June 1998). 

According to an embodiment of the present invention, a 
parametric study can take discrete steps through changes in 
initial state or system parameters and tabulate simulation 
results. The parametric study will allow the user to easily 
change in fixed increments initial configurations, control 
parameters, surface properties, weights, lengths, end effec- 
tors, motor torques, and actuator effectiveness, and tabulate 
the results of those changes. Results may include (but may not 
be limited to) measures of sensor saturation, visibility, speed, 
mobility, balance, end-effector placement, and/or manipula- 
tion. 

The design of the parametric study can include: 1) repre- 
sentation changes to the initial state and system, and 2) a 
representation of the results of the simulation runs. For each 
of these, there can be two levels of configuration, one com- 
prehensive and one simplified. 

The simplified approach can use one stated system com- 
bined with a collection of sets of changes. Each element in the 
collection will itself be a collection of data sets that may 
include 1) the manipulator index, 2) the starting link, and 3) a 
vector of new values for the joint variables. When the speci- 
fied link is the base link, the first seven values will represent 
the position and orientation (through a quaternion) of the 
base. This is illustrated in FIG. 8a. 

In FIG. 8a, the simple form of input to the parametric study 
uses a reference stated system, control system, and run time. 
It applies a vector of modifications to these reference values. 
Each modification is composed of multiple data sets. The first 
set holds state changes. The second set holds end-effector 
position changes. The third set is a group of capture times and 
the output is saved for each capture time. 

The comprehensive approach to configuring a parametric 
study may represent each step in the study by a system, state, 
end-effector placement, and run time. With this, it will be 
possible to change at one extreme just one joint value and at 
the other extreme the complete system, state, and desired- 
positioning description. The comprehensive input to a para- 
metric study can be organized as shown in FIG. 8b, wherein 
the comprehensive form of the input to the parametric study 
uses any number of system changes combined with any num- 
ber of state, placement, and run-time changes. In FIG. 8/?, 
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each combination has a corresponding simple parametric 
study (matching that shown in FIG. 8a). 

The output of each parametric study can be either a com- 
plete state or a specified subset of the state. The complete state 
5 will be comprehensive, while the subset will be a simplified 
form that will use less memory for storage. A subset can be 
specified through a vector of manipulator, starting link, end- 
effector, and/or number of values. This will allow any part of 
either the explicit state or the end-effector positions/orienta- 
10 tions to be captured. More complex functions of the output 
values can be post-processed (see processing tool 20 in FIG. 
1), using, for example, MATLAB, MATHEMATICA, or 
EXCEL. 

Furthermore, according to an embodiment of the present 
1 5 invention, a Monte Carlo study can be performed by selecting 
random initial values for the system and state parameters 
described above for the parametric study. In addition to ran- 
dom initial values, noise is input to sensor and actuator mod- 
els. The noise models for the sensors and actuators can be 
20 built into the classes that define them. The initial conditions 
for the system state can be selected based on a set of prob- 
ability density functions. The selected values for a time 
sequence of other parameters, e.g., desired end-effector posi- 
tions can also be set using probability density functions. 

25 According to a further embodiment of the present inven- 
tion, the parameter optimization study can enable the optimi- 
zation of system parameters based on criteria defined through 
Monte Carlo studies. It can use stochastic optimization tech- 
niques, which do not require smooth, or even continuous, 
30 metrics, for optimization. This is a powerful approach built on 
the best tools used for analysis (Monte Carlo simulation and 
stochastic optimization), specifically tailored to the needs of 
robot designers (contrasting with more theoretical tech- 
niques, e.g., see H. Lipson, and J. B. Pollack, “Automatic 
35 Design and Manufacture of Robotic Lifeforms”, Nature 406, 
974-978, 2000). The results of a parameter optimization 
study can be new robotic parameters, such as length, mass 
motor torque, or sensor placement, which will be communi- 
cated back into the design process for review and used in the 
40 next design cycle. 

Moreover, the parameter optimization study can leverage 
parallel processing. Algorithms and software for parameter 
optimization studies that can be separated, where possible, 
into independent pieces can either be executed in sequence on 
45 a single-core processor or in parallel on multiple processors 
or cores, according to an embodiment of the present inven- 
tion. 

According to a further embodiment of the present inven- 
tion, a system for network communications can be used. This 
50 system can be specifically tailored to the exchange of robotic 
design and validation information through the XML lan- 
guage, allowing for a networked validation system that is easy 
to use yet robust. The organization that was shown in FIG. 3 
supports both client-server and peer-to-peer architectures. If 
55 there is just one routing node, it plays the role of a server. If 
there are multiple routing nodes, they exchange information 
and hand-off client interfaces to form a robust infrastructure 
of connections, as shown in FIG. 9, wherein the architecture 
supports peer-to-peer organization, with connections 
60 between clients routed through a network of routing nodes, 
which allows selected components to organize communica- 
tion as shown in FIG. 3. 

For two client nodes to exchange information, they must 
discover a common routing node. Over a LAN (local area 
65 network), client nodes can find server nodes using UDP (user 
datagram protocol) broadcast. Broadcast addresses exist at 
both the hardware and IP (internet protocol) level. On an IP 
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network, broadcasts can be addressed to the four-byte IP 
address 255.255.255.255, allowing the message to reach 
every computer on a physical network (without passing 
through routers). 

The client nodes send periodic messages seeking LAN 
routing nodes in this way. Each LAN routing node responds 
to the broadcast messages to inform the client node of its 
presence. After this acknowledgement, a client node can 
request information from the LAN routing node at any time, 
including identification of other LAN client nodes and of 
WAN (wide area network) routing nodes. For communicating 
information on nodes, a set of string- string, string-float, and 
string-integer maps can be used, described through the XML. 
This generic approach allows new information to be easily 
incorporated and consumed. 

Moreover, networked operation may allow interactive 
engineering collaboration, support engineers wanting to run 
validation software on fast remote computers while working 
on a desktop, enable interactive demonstrations to managers 
or other non-engineers, and support parallelization of simu- 
lation runs. To enable optimal performance in both LAN and 
WAN (public Internet) environments, each client can main- 
tain contact with LAN and WAN routing nodes. The LAN 
routing node will be inside the most local NAT (see K. Ege- 
vang and P. Francis, “The IP Network Address Translator 
(NAT)”, RFC 1631, IETF, May 1994) or firewall, and the 
WAN routing node will be outside the farthest NAT or fire- 
wall. Client nodes needing to communicate with other client 
nodes that are between the nearest and farthest NAT devices 
or firewalls can communicate in WAN mode. This is illus- 
trated in FIG. 10 , wherein each client can maintain both a 
primary LAN routing node and a primary WAN routing node. 
This allows high-performance LAN operation, while provid- 
ing a firewall and NAT (Network Address Translator) friendly 
design for the Internet communication. The client and routing 
nodes will interact in the validation system as shown in FIG. 
3. 

Furthermore, determination of whether a client node is 
behind a firewall can be made using an approach related to the 
Simple Traversal of UDP Through NATs (STUN) protocol 
(see J. Rosenberg, J. Weinberger, C. Huitema, and R. Mahy, 
“STUN: Simple Traversal of User Datagram Protocol (UDP) 
through Network Address Translators (NATs),” RFC 3489, 
IETF, March 2003) developed by the Internet Engineering 
Task Force (IETF). The STUN protocol allows any STUN 
client to communicate with a STUN server on the public 
Internet to determine if it is behind a NAT and what type of 
NAT it is. 

Dynamic simulation of terrain is computationally expen- 
sive, and according to a further embodiment of the present 
invention, different environment configurations can be used 
in a variety of deformation models based on the level of 
fidelity required for each component. In addition to the robot, 
segments of terrain can be modeled as independent manipu- 
lator objects, as illustrated in FIG. 11a. Terrain features will 
be separated into links and shapes. The most common shape 
type will be a polyhedron, with each face having a unique 
surface property. The deformation architecture can use this 
approach with the FIG. 7 framework, where each link in the 
system can be deformed using a morphing state. In FIG. 11a, 
in the terrain simulation, not just the robotic mechanism, but 
all components of the terrain, including multiple segments of 
ground and independently moving rocks, will be modeled as 
manipulators. This will support maximum realism and opti- 
mal selection of algorithms for simulating interactions. 

For example, two deformation methods for terrain-robot 
interaction modeling can be used. The first is the radius of 
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influence method, which offers good runtime performance 
(<1 ms processor time per time step on PC hardware using a 
moderate mesh size) for elastic interactions. The radius of 
influence method is demonstrated in FIG. 116. It works as 
5 follows: first a penetration vector is found, representing the 
location of an impinging foot or wheel with the ground sur- 
face. A highly connected data structure is used to find all 
nodes lying within the radius of influence, a configurable 
parameter. For each node, the depth in the direction of the 
to penetration vector has a magnitude that is a function of the 
node distance from the impact center and tends toward zero 
for more distant nodes. This technique is well suited for 
simulating the flexibility of robot parts touching terrain. 

The second method which can be used is the gridded com- 
15 pliance using a uniform surface grid, as discussed by R. W. 
Sumner, J. F. O’Brien, and J. K. Hodgins in “Animating Sand, 
Mud, and Snow,” Computer Graphics Forum , vol. 18, no. 1, 
1999. This is well suited for simulating soil interactions (e.g., 
with sand or stiff terrain). Each cell in the grid is treated 
20 independently, and force and movement are calculated as 
properties of the impinging depth and soil properties. The soil 
properties can be established as those described by X. Li and 
J. M. Moshell, in “Modeling Soil: Realtime Dynamic Models 
for Soil Slippage and Manipulation,” Proceedings of the 20 th 
25 Annual Conf. on Comp. Graphics and Interactive Techniques , 
pp. 361-368, 1993 and extended by C. Grand, F. B. Amar, P. 
Bidaud, and G. Andrade, in “A Simulation System for Behav- 
ior Evaluation of Off-Road Mobile Robots,” Proceedings of 
the CLAWAR 2001 Conference , pp. 307-314, 2001 . 

30 As explained above, the invention provides both a method 
and corresponding equipment consisting of various modules 
providing the functionality for performing the steps of the 
method. The modules may be implemented as hardware, or 
may be implemented as software or firmware for execution by 
35 a computer processor. In particular, in the case of firmware or 
software, the invention can be provided as a computer pro- 
gram product including a computer readable storage structure 
embodying computer program code (i.e., the software or 
firmware) thereon for execution by the computer processor. 

It is to be understood that the above-described arrange- 
ments are only illustrative of the application of the principles 
of the present invention. Numerous modifications and alter- 
native arrangements may be devised by those skilled in the art 
without departing from the scope of the present invention, and 
the appended claims are intended to cover such modifications 
45 and arrangements. 

What is claimed is: 

1. A method for generating a validation system to validate 
a robot design of a robotic system, comprising: 

50 automatically converting a robot design into a generic 
robotic description using a predetermined format; 

automatically generating a control system from the generic 
robotic description; and 

updating robot design parameters of said robotic system 
55 with an analysis tool using said generic robot description 

and said control system; 

wherein updating the robot design parameters is performed 
at run time allowing for variations in motion of the 
robotic system. 

2 . The method of claim 1 , wherein said robot design is 
60 loaded from robot design software. 

3. The method of claim 1, wherein the robot design com- 
prises at least one of: 

a hardware design, an electronic design, and surface prop- 
erties. 

65 4 . The method of claim 1 , wherein said analysis tool pro- 

vide a simulation and said simulation is at least one of: 

a kinematic simulation, 



